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DETAILED ACTION 

Claim Rejections - 35 USC § 102 

1. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

2. Claims 1, 6, 8-11, 15, 17, 23-24, 26-29, 31-33, and 35-37 are rejected under 35 
U.S.C. 102(e) as being anticipated by Monroe (US 6970183 B1). 

Re claim 1, Monroe discloses a method for the monitoring of an environment, 
comprising the steps of: a) defining and storing in a memory programs for processing, in 
real-time, data obtained from the observation of objects by one or more pairs of optical 
and/or thermal imagers, relatively positioned along a common vertical line, for 
identifying said objects and determining whether they are dangerous (Monroe: column 
31, lines 37-56); b) determining and storing parameters according to which the 
observation of the controlled space is effected (Monroe: column 7, lines 34-40, 
recording); c) carrying out photographic observation of the controlled space or sections 
thereof, according to the aforesaid observation parameters (Monroe: column 33, lines 
12-53); and d) jointly processing the digital data representing said optical and thermal 
photographs, to determine whether possible dangerous objects have been detected, 
and if so, classifying said objects according to the stored danger parameters (Monroe: 



Application/Control Number: 10/521,207 Page 3 

Art Unit: 2621 

column 28, lines 8-45, audio and infrared sensor data is utilized in addition to the video 
data). 

Re claim 6, Monroe discloses determining an action on an authorized body that 
will eliminate the danger of collision, intrusion or damage (Monroe: column 4, lines 6-8, 
response to an alarm event may include the dispatch of response personnel). 

Re claim 8, Monroe discloses giving alarms signaling the presence and nature of 
any dangerous objects, the danger of collisions and possible desirable preventive 
actions (Monroe: column 18, lines 58-61, additional information including the type of 
event may be provided). 

Re claim 9, Monroe discloses that the photographic observation is carried out by 
performing the steps of: a) modifying the angle of one or more photographic devices 
(Monroe: column 28, lines 52-57, object tracking may include panning the camera); b) 
photographing one or more photos with said photographic device (Monroe: column 4, 
lines 1-5, high resolution images and video clips are processed by the system); c) 
processing said photographed one or more photos by a computerized system (Monroe: 
column 4, lines 6-8, processors are used for automatic event assessment); and d) 
repeating steps a) to c) (Monroe: column 37, line 62-column 38, line 5, the cycle 
repeats). 

Re claim 10, Monroe discloses that the photographic observation is carried out 
as a continuous scan or segmental scan (Monroe: column 7, lines 50-56, the monitoring 
station can monitor the data continuously). 
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Re claim 11, Monroe discloses a) setting initial definition for the photographic 
observation and for the processing of the data of said photographic observation 
(Monroe: column 33, lines 12-23, the system is responsive to programmed events); b) 
storing in the memory the data that represent the last photographed one or more photos 
at a specific angle of the photographic devices (Monroe: column 33, lines 12-23, the 
system learns that an object belongs or does not belong at a specific location); and c) 
processing said data for detecting suspected objects, by performing, firstly, pixel 
processing and secondly, logical processing (Monroe: column 33, lines 12-23, the 
system recognizes objects and then determines whether they belong at a location); and 
d) deciding whether said suspected object is a dangerous object (Monroe: column 33, 
lines 12-23, detected changes signal an alarm). 

Re claim 15, Monroe discloses that the logic processing comprises the steps of: 
a) measuring parameters regarding the pixels in the logic matrix (Monroe: column 33, 
lines 12-23, the system is capable of learning where objects are located by monitoring 
scenes over time); b) comparing said measured parameters to a predetermined table of 
values stored in the memory, whenever said measured parameters equal to one or 
more values in said table, the pixels that relates to said measurement are dangerous 
objects (Monroe: column 33, lines 19-20, any changes activate an alarm). 

Re claim 17, Monroe discloses that the photographic observation is taken from 
at least two cameras (Monroe: Fig. 40). 
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Re claim 23, Monroe discloses a) generating a panoramic image and a map of 
the monitored area by scanning said area, said scanning being performed by rotating at 
least a pair of distinct and identical imagers around their central axis of symmetry 
(Monroe: column 28, lines 62-64, wide angle feature; Fig. 40, two cameras mounted); b) 
obtaining the referenced location of a detected object by observing said object with said 
imagers, said location being represented by the altitude, range and azimuth parameters 
of said object (Monroe: column 28, lines 46-47, GPS receiver provided for generating 
location information; column 28, line 64-column 29, line 2, range finder permits locating 
objects in a precise manner); and c) displaying the altitude value of said object on said 
panoramic image and displaying the range and the azimuth of said object on said map 
(Monroe: column 16, lines 14-15; column 23, lines 32-35, a portable device may display 
maps along with alphanumeric text). 

Re claim 24, Monroe discloses that the imagers are photographic devices 
selected from the group consisting of: CCD or CMOS based cameras or Forward 
Looking Infra Red (FLIR) cameras (Monroe: column 6, lines 5-8). 

Re claim 26, Monroe discloses that the imagers are not identical and do not 
share common central axis of symmetry or of optical magnification but have at least an 
overlapping part of their field of view (Monroe: Fig. 40, infrared sensor 562 and camera 
558). 

Re claim 27, Monroe discloses documenting the activities of the wildlife and 
other dangerous objects, for preventing and reducing from said wildlife and said other 
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dangerous objects to appear at the monitored area (Monroe: column 4, lines 6-8, 
response to an alarm event may include the dispatch of response personnel). 

Re claim 28, Monroe discloses a) one or more pairs of optical and/or thermal 
imagers, relatively positioned along a common vertical line for carrying out 
photographic/thermal observation of the controlled space or sections thereof (Monroe: 
column 5, lines 42-46); b) a set of motors for changing the sections of the said 
photographic observation (Monroe: column 5, line 65-column 6, line 5); c) elaborator 
means for jointly processing the digital data representing said optical and thermal 
photographs, to determine whether possible dangerous objects have been detected, 
and if so, classifying said objects according to the stored danger parameters, 
processing the digital data representing the photographs taken by said photographic 
devices (Monroe: column 28, lines 37-39); d) memory means for storing programs for 
processing, in real-time, data obtained from the observation of objects by said imagers, 
and for identifying objects and determining whether they are dangerous (Monroe: 
column 3, lines 37-56). 

Re claim 29, Monroe discloses that the photographic devices comprise one or 
more CCD or CMOS cameras and/or one or more infrared cameras (Monroe: column 6, 
lines 5-8). 

Re claim 31, Monroe discloses that the photographic devices are at least a pair 
of distinct and identical imagers (Monroe: Fig. 40; column 27, lines 11-24). 
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Re claim 32, Monroe discloses that each photographic device is provided with a 
different lens (Monroe: Fig. 40, separate cameras). 

Re claim 33, Monroe discloses a) elaborator means for obtaining the referenced 
location of a detected object in said controlled space, said location being represented by 
the altitude, range and azimuth parameters of said object (Monroe: column 28, lines 46- 
47, GPS receiver provided for generating location information; column 28, line 64- 
column 29, line 2, range finder permits locating objects in a precise manner); b) means 
for generating a panoramic image and a map of the monitored area (Monroe: column 
28, lines 62-64, wide angle feature); c) means for displaying the altitude value of said 
object on said panoramic image and means for displaying the range and the azimuth of 
said object on said map (Monroe: column 16, lines 14-15; column 23, lines 32-35, a 
portable device may display maps along with alphanumeric text). 

Re claim 35, Monroe discloses that the elaborator means are one or more 
dedicated algorithm installed within the computerized system (Monroe: column 31, lines 
37-56, instructions stored). 

Re claim 36, Monroe discloses a laser range finder being electrically connected 
to the computerized system for measuring the distance of a detected object from said 
laser range finder, said laser range finder transfers to said computerized system data 
representing the distance from a detected object, thereby aiding said computerized 
system to obtain the location of said detected object (Monroe: column 28, line 64- 
column 29, line 2, range finder permits locating objects in a precise manner). 



Application/Control Number: 10/521,207 Page 8 

Art Unit: 2621 

Re claim 37, Monroe discloses procuring, adjourning and storing in a memory 
files representing the background space (Monroe: column 33, lines 12-23, the system is 
capable of learning where objects are located by monitoring scenes over time). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 2, 3, 5, 7, 14, and 16 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Monroe (US 6970183 B1) in view of Lipton (US 6954498 B1). 

Re claim 2, Monroe discloses a) changing the sections of the said photographic 
observation so as to monitor the path of any detected dangerous objects (Monroe: 
column 28, lines 52-59, tracking); b) receiving and storing the data defining the positions 
and the foreseen future path of all authorized bodies (Monroe: column 28, lines 8-15); 
and d) comparatively processing said assumed future path with the foreseen future path 
of all authorized bodies, to determine the possible danger of collision or intrusion 
(Monroe: column 34, lines 56-64, deviations from a pattern trigger an alarm). 

Monroe does not specifically disclose c) extrapolating the data obtained by 
monitoring the path of any detected dangerous objects to determine an assumed future 
path of said objects. However, Lipton discloses an interactive video manipulation 
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system, wherein positions are predicted from a tracking algorithm (Lipton: column 7, 
lines 27-37). Since Monroe and Lipton both relate to surveillance, one of ordinary skill 
in the art at the time of the invention would have found it obvious to combine the 
prediction of Lipton with the system of Monroe in order to facilitate the tracking of 
multiple objects in a frame (Lipton: column 7, lines 14-26). 

Re claim 3, Monroe discloses determining an action on dangerous objects that 
will eliminate the danger of collision, intrusion or damage (Monroe: column 4, lines 43- 
57, response to an alarm event). 

Re claim 5, Monroe does not disclose that the action is change in their assumed 
future path the dangerous object. However, Lipton discloses that the predicted position 
is compared to the actual position to determine a more accurate predicted path (Lipton: 
column 7, lines 27-37). Since Monroe and Lipton both relate to surveillance, one of 
ordinary skill in the art at the time of the invention would have found it obvious to 
combine the prediction of Lipton with the system of Monroe in order to facilitate the 
tracking of multiple objects in a frame (Lipton: column 7, lines 14-26). 

Re claim 7, neither Monroe nor Lipton specifically discloses that the action is a 
delay in their landing or take-off of the aircraft or a change of their landing or take-off 
path. However, the Examiner takes Official Notice that one of ordinary skill in the art at 
the time of the invention would have found it obvious that in the event that a hazardous 
item endangered an aircraft's take-off or landing, appropriate diversionary measures 
would be taken to eliminate possible threats to the aircraft, passengers, and/or cargo. 
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Re claim 14, Monroe does not specifically disclose the claimed features. 
However, Lipton discloses a) generating an average photo from the current one or more 
photos (Monroe: column 33, lines 12-23, the system learns that an object belongs or 
does not belong at a specific location and recognizes whether the objects in a frame 
belong there); b) generating a derivative matrix from said average photo for emphasis 
relatively small objects at each photo from said one or more photo, which might be 
potential dangerous objects (Lipton: column 5, lines 41-60); c) storing said derivative 
matrix in the memory as part of a photo database, and comparing said derived matrix 
with previous derivative matrix stored in said memory as part of said photo database, 
said previous derivative matrix is derived from one or more photos that was taken from 
the exact photographic device angle as of said average photo (Lipton: column 5, lines 
41-60); d) From the comparison, generating an error photo, wherein each pixel in said 
error photo represents the error value between said derivative matrix and said previous 
derivative matrix (Lipton: column 5, lines 41-60); e) comparing the value of each pixel 
from said error photo to a threshold level, said threshold level is dynamically determined 
to each pixel in the error photo statistically according the previous pixel values stored in 
the memory as a part of a statistic database (Lipton: column 5, line 61 -column 6, line 
18); f) whenever a pixel value in said error photo exceeds said threshold level, 
generating a logic matrix in which the location of said pixel value is set to a 
predetermined value (Lipton: column 5, line 61-column 6, line 18); and g) upon 
completing comparing each error value to said threshold level, for the entire current 
photos, transferring said generated logic matrix to the logic process stage (Lipton: 
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column 6, lines 41-44, pixels are clustered into regions of interest). Since Monroe and 
Lipton both relate to surveillance, one of ordinary skill in the art at the time of the 
invention would have found it obvious to combine the prediction of Lipton with the 
system of Monroe in order to facilitate the tracking of multiple objects in a frame (Lipton: 
column 7, lines 14-26). 

Re claim 16, Monroe does not specifically disclose the claimed features. 
However, Lipton discloses that the parameters are selected from the group consisting of 
the dimension of an adjacent group of pixels, the track that one or more adjacent pixels 
created in the logic matrix, direction, speed, size and location of an object that is 
created from a group of pixels (Lipton: column 7, lines 27-37). Since Monroe and Lipton 
both relate to surveillance, one of ordinary skill in the art at the time of the invention 
would have found it obvious to combine the prediction of Lipton with the system of 
Monroe in order to facilitate the tracking of multiple objects in a frame (Lipton: column 7, 
lines 14-26). 

4. Claims 18-22, 25, 30, and 34 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Monroe (US 6970183 B1) in view of Milgram et al. (US 5175616 
A, hereinafter referred to as "Milgram"). 

Re claim 18, Monroe does not specifically disclose the claimed features. 
However, Milgram discloses that the camera separation affects the focal point of the 
imaging system, wherein by adjusting the camera configuration to meet the needs of the 
operator, the task of the operator is theoretically facilitated (Milgram: Figs. 11A-11Eand 



Application/Control Number: 10/521,207 Page 12 

Art Unit: 2621 

column 28, line 35 through column 29, line 3). Therefore, one of ordinary skill in the art 
at the time of the invention would have found it obvious that a distance of 0.5 to 50 
meters between cameras would simply be categorized as a design choice by the 
operator for facilitating his needs. Since Monroe and Milgram relate to surveillance 
systems, one of ordinary skill in the art at the time of the invention would have found it 
obvious to combine the stereoscopic coordinate system of Milgram with the system of 
Monroe in order to provide enhanced 3-D interaction from the operator (Milgram: 
column 3, lines 41-60 and column 4, lines 10-29). 

Re claim 19, Monroe discloses that the cameras positioned with same view 
angle are installed on the same pole (Monroe: Fig. 40). 

Re claim 20, Monroe discloses that the cameras positioned with same view 
angle are being rotated thus their view angle is changed simultaneously (Monroe: Fig. 
40, rotation of the pole causes the cameras to rotate together). 

Re claim 21, Monroe discloses providing at least one encoder and at least one 
reset sensor for determining the angle of each camera, said encoder and reset sensor 
are provided to each axis that rotates a camera (Monroe: Fig. 55 and column 37, lines 
44-49, encoder 1044; column 4, lines 36-40, the system may be configured and 
reconfigured). 

Re claim 22, Monroe discloses that the reset sensor provides the initiation angle 
of the camera at the beginning of the scanning of a sector and the encoder provides the 
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current angle of the camera during the scanning of the sector (Monroe: column 4, lines 
36-40, the system may be configured and reconfigured). 

Claim 25 has been analyzed and rejected with respect to claim 18 above. 

Claim 30 has been analyzed and rejected with respect to claim 18 above. 

Re claim 34, Monroe does not specifically disclose that the means for displaying 
the monitored area are using three-dimensional software graphics where the location of 
each detected object is indicated as a three-dimensional image. However, Milgram 
discloses a stereoscopic video-graphic coordinate specification system, wherein 
stereoscopic video is employed in remote surveillance systems to generate 3-D 
information (Milgram: column 1, lines 5-10 and column 3, line 63-column 4, line 2). 
Since Monroe and Milgram relate to surveillance systems, one of ordinary skill in the art 
at the time of the invention would have found it obvious to combine the stereoscopic 
coordinate system of Milgram with the system of Monroe in order to provide enhanced 
3-D interaction from the operator (Milgram: column 3, lines 41-60 and column 4, lines 
10-29). 

5. Claims 12 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Monroe (US 6970183 B1) in view of Lipton (US 6954498 B1) in view of 
Milgram et al. (US 5175616 A, hereinafter referred to as "Milgram"). 

Re claim 12, Monroe does not specifically disclose that the pixel processing 
comprises the step of: a) Mathematically processing each pixel in a current photo for 
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detecting suspected objects. However, Lipton discloses performing a sum of absolute 
differences (SAD) (Lipton: column 7, lines 38-51, sum of absolute differences (SAD) 
performed), wherein each pixel in a block is compared to the corresponding pixel in 
another block, and the differences are summed. Since Monroe and Lipton both relate to 
surveillance, one of ordinary skill in the art at the time of the invention would have found 
it obvious to combine the prediction of Lipton with the system of Monroe in order to 
facilitate the tracking of multiple objects in a frame (Lipton: column 7, lines 14-26). 

Neither Monroe nor Lipton specifically discloses that b) Whenever a suspected 
object is detected, at least two photographic devices, being positioned vertically one 
above the other in distance from each other, provides photos at same time period and 
same monitored section, generating data regarding said suspected object from at least 
said two photographic devices, said generated data is a 3-D data. However, Milgram 
discloses a stereoscopic video-graphic coordinate specification system, wherein 
stereoscopic video is employed in remote surveillance systems to generate 3-D 
information (Milgram: column 1, lines 5-10 and column 3, line 63-column 4, line 2). 
Since Monroe, Lipton, and Milgram relate to surveillance systems, one of ordinary skill 
in the art at the time of the invention would have found it obvious to combine the 
stereoscopic coordinate system of Milgram with the system of Monroe and Lipton in 
order to provide enhanced 3-D interaction from the operator (Milgram: column 3, lines 
41-60 and column 4, lines 10-29). 

Re claim 13, Monroe discloses that whenever the pixel processing detects 
moving object, it comprises the steps of: a) comparing the current photo to an average 
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photo generated from the previous stored photos, said previous stored photos and said 
current photo was photographed at the same photographic device angle (Monroe: 
column 33, lines 12-23, the system learns that an object belongs or does not belong at 
a specific location and recognizes whether the objects in a frame belong there). 

Monroe does not specifically disclose b) generating a comparison photo from the 
difference in the pixels between said average photo said current photo, each pixel in 
said comparison photo represents an error value; c) comparing each error value to a 
threshold level, said threshold level is dynamically determined to each pixel in the photo 
matrix statistically according the previous pixel values stored in the memory as a 
statistic database; d) whenever a pixel value in said comparison photo exceeds said 
threshold level, generating a logic matrix in which the location of said pixel value is set 
to a predetermined value; and e) upon completing comparing each error value to said 
threshold level, for the entire current photos, transferring said generated logic matrix to 
the logic process stage. However, Lipton discloses b) generating a comparison photo 
from the difference in the pixels between said average photo said current photo, each 
pixel in said comparison photo represents an error value (Lipton: column 5, lines 41-60); 
c) comparing each error value to a threshold level, said threshold level is dynamically 
determined to each pixel in the photo matrix statistically according the previous pixel 
values stored in the memory as a statistic database (Lipton: column 5, lines 41-60); d) 
whenever a pixel value in said comparison photo exceeds said threshold level, 
generating a logic matrix in which the location of said pixel value is set to a 
predetermined value (Lipton: column 5, line 61-column 6, line 18); and e) upon 
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completing comparing each error value to said threshold level, for the entire current 
photos, transferring said generated logic matrix to the logic process stage (Lipton: 
column 6, lines 41-44, pixels are clustered into regions of interest). Since Monroe and 
Lipton both relate to surveillance, one of ordinary skill in the art at the time of the 
invention would have found it obvious to combine the prediction of Lipton with the 
system of Monroe in order to facilitate the tracking of multiple objects in a frame (Lipton: 
column 7, lines 14-26). 

6. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Monroe (US 6970183 B1) in view of Goldenberg et al. (US 6113343 A, hereinafter 
referred to as "Goldenberg"). 

Re claim 4, neither Monroe nor Lipton discloses that the action is the destruction 
of the dangerous object. However, Goldenberg discloses an explosives disposal robot, 
which uses surveillance techniques to locate and approach, ultimately destroying, 
hazardous items (Goldenberg: Abstract section). Since Monroe, Lipton, and 
Goldenberg use surveillance techniques, one of ordinary skill in the art at the time of the 
invention would have found it obvious to combine the destructive property of 
Goldenberg with the system of Monroe and Lipton in order to safely assist in explosive 
ordinance disposal without endangering humans. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHRISTOPHER FINDLEY whose telephone number is 
(571)270-1199. The examiner can normally be reached on Monday-Friday (8:30 AM- 
5:00 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha D. Banks-Harold can be reached on 571-272-7905. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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